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fids evaluation of tba daoc mto a lle e d Open ImullMit psugSHM 
oondnotod la the Bew Toxic City public aohoola during tba 1969-70 
school yaar with funds provided by Title X of tba Blaaontary and 
Sscoadaxy Education lot eovers program e dovslopsd and Implemented at 
tba school district level. Klaeteea different districts received 
Ands for programs under the general heading of "Open Enrollment" 
aai tba progress had varied interests and e mpha s e s, reflecting local 
conditions and c on c ern s. 

OBJECTIVES OP THE DISTRICT PROGRAM 

fho evaluation design was developed fron thos items noted in 
the district proposals under the headin g "Objectives •“ The objectives 
can be grouped into three areas, l) those concerned with general or 
specific aspects of academic improvement, 2) those concerned with the 
nature of the school *s service, in cl udin g both the provisions of guidance 
ani counseling services, and the modification and/or improvement in 
staff the instructional process, and 3) those concerned with some 
dimension of the social process or the child's personal (non- a c a d em ic ) 
functioning. 

THE EVALUATION PLAN 
The Foci o f Evaluation 

The overall plan for the evaluation had three major foci. The 
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first mi to mlwti tbo extent to iMeh tbo piogzam slnents, m 
•pooifiod in tbo sswrsl district proposals, mm in foot Implemented. 
fho otbor too fool involnd only a esmpls of olx distxlote. tbo 
—w ud i focus na on -participant reaction," ohloh Involved determining 
tbo zoootion of children, mothers, telphers, priaoip o lo , and diotxiot 
Utlo I coordinators. Tbo third focus uss on tbo quality of tbo 
"pxogxan" as it oos implemented within tbo sample schools. 



Ww different instruments were used* For the evaluation of 
program implementation, a questionnaire was sent to the princip a ls 
of the 2lfi schools scheduled to be receiving schools asking about 
thei r roles in the development of the districts* proposals and the nature 
of the services provided their school* Then interviews were held 
with the Title I coordinators of the six sample districts, using an 
informal interview guide concentrating on program implementation* 
Participant reaction was estimated through three brief questionnaires, 
to teachers, parents, and pupils. Aspects of the quality of the prog- 
ram were estimated through four instruments completed by the educators 
and parents from the evaluation staff. These were a scale for rating 
aspects of the physical condition and educational climate of the 
school building, two separate sc.ales (one for educators, one for 
parents) for rating, aspects of the 175 individual lessons observed, 
and a eooiometric-type form for recording intra-class interactions. 
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Data obtained fro* coordinators and princi pa ls iadioat a d that 
tha program had generally b— n lapis — gated aa p l a nn ed. Both eoordln- 
gtm aad principals vara oanoemed with tha tlM schedule for tha 
pro gram, believing that aa aarliar aazlaa of budget approval atapa 
would provide for aaTltar arrival of supplies and aataxlala and aora 

j 

afflolaat recruitment of ataff • Both too aaw a saad for greater 
parental Involvement. Hew principals reported any active role in tha 
preparation of the dlatzlet proposal, and one in five reported feeling 
"not at all familiar vith it" Indicating a need both for better or- 
ientation and improved involvement by p rin c ip al * in tha generation of 
these decentralized proposals. 

The data provided by principals indicate that ataff used to 

S 

g 

provide services to children for the program typioally had been pro— | 

viding similar services to the school population before the school was jj 

de sig nated a "reoeiving school" and principals and teachers both noted 

ij 

the need for additional professional (and paraprof eesional ) staff. j 

Pn-rctmtionH of Ko t >™™ and Children^ Achleveaont^ltt 

Beading 

The emai l sample of mothers responding were almost unanimously 
positive in their ratings, expressing satisfaction with the progress of 
their chil dren. They indicated little activity in or towards the 
school, corroborating the coordinators' and principals* view of the 







i 



I? 



on d for greater puntal lanlioMBt* C hildr en too* mm msi 
poaltlTi than oagtiiTi la thoir fw* napooai oooMBta* tto lor 
xm taxa atn for aothozo and ohllAxoa Halt say «o*e conclusive mm- 
waxy of their et e fce — i nt e. 

In achievement, the pattern within tho sample districts 

m ild ao widely that an ovezell conclusion ia not oon a ldor ad valid. 

At ana it tn at, ball of tha Open Enrollment ohildxaa in oaa diatzlot 
ahonad naxaal progress in r ea di n g at both tha tlaantwy and Junior 
high school level, a soxnal pattern* At tha other axtzaaa ware two 
diet riots in which few children showed normal progress at either level, 
and in between were the other sample districts with normal progress 
patte rns at the elementary, but not the Junior h ig h schoo l level* 

Perceptions of Observers 

Where comparable questions were asked, both professional and 
parent observers provided the same response pattern, and so these data 
can be sxmmarized together. School building and school climate were 
rated positively, as was the general climate of classes and the 
organization and planning of the lessons observed. At both elementary 
and Junior high school levels, the children were considered to be 
working at appropriate tasks, to be well behaved and interested, 
with active participation and good understanding and verbal fluency. 

Teachers too were rated positively at both levels, and their 
personal qualities were the most frequent lesson strengths noted by 
the observers. Weaknesses in the lesson were more often methodological. 





7 



V 



Dm professional obatma also obamd and rated upaeta of 
special pag raaa la ssssflial zaadiag, and guidance and four individual 
pag aaa dsveloped la two of ttaa sample districts. These data waxo 
consistently positive particularly the evaluation of ttaa Indiv idu a l 
diet riot programs. 

3m final aspect of ttaa obaarvatlona involved ttaa xeooxding 
and classification (on a positive-negative continuum) of ttaa intar- 
actions scan within each class, considering ttaa role, sex, and attanlo 
status of the initiator and recipient of tbs interaction, da inter- 
actions observed ware predominantly positive, whether involving the 
teacher, or the children. With one exception, positive interactions 
were observed between children of all three ethnic gro up s studied 
(White, Black, and Spanish-speaking) at both elementary and junior 
hig h school levels. Moreover, the majority of negative interactions 
fuiuvng pupils were directed towards other children of the same ethnic 
group, so that there were few negative interactions across groups. 

CONCLUSIONS ABOUT EVALUATION FOCI 

In terms of the three fool of this evaluation, the data provide 
a basis for the following conclusions : 

1. The progr a m was essentially implemented as proposed, and 
certainly the legal commitments to expend the funds in p re-specified 
ways was also mot. While there was considerable confusion at the 
individual sohool level as to just who and what was supported by 
program funds, this confusion did not obscure the basic fi n di n g that 
support was provided at the scale envisioned. 
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2# 1 to participant* studied, coordinator*, principal*, teaohers, 
parent* art children, vara generally positive In their paioaptiona 
otf the pr ogres. 

3. The quality of the separata distrLot progress observed va* 
also rated poaitiTaly by both professional and parent asnbezs of the 
obaervatlon teas. Partioolar praise was given sons of the special 
progress developed in Districts 11 and 22* 



CHAPTER I 



INTRODUCTION 

This is an evaluation of the decentralized Open Enrollment pro- 
grams conducted in the New York City public schools during the 1969-70 
school year with funds provided by Title I of the Elementary and Secondary 
Education Act, This evaluation was contracted for with the Bureau of 
Research of the central Board of Education, but the programs under study 
were all developed and implemented at the school district level. In 
many cases the districts involved chose the alternative available to 
them of contracting for district evaluations of the Open Enrollment pro- 
gram as well as district evaluations of their other decentralized pro- 
grams. As Table II-l indicates, the 19 different districts which re- 
ceived funds for programs under the general heading of "Open Enrollment" 
had varied interests and emphases, reflecting local conditions and con- 
cerns, Thus, there is no meaningful entity which might be called the 
Open Enrollment "program," in the sense of characterizing all parti- 
cipating districts and schools. Rather there are some emphases, such 
as the emphasis on reading or on guidance services, which are common 
to more than one district. There are also unique emphases such as the 
one planned by one district to make educational use of the bus ride to 
and from school* 

In addition to the differences between districts the several 
schools in a district were free to develop their own emphases and pro- 
gram variations. Therefore, we first sampled districts and then sampled 
schools within the districts. In analyzing the data and in preparing 
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this report the school and district were the basic units of study. 
Generalizations about the Open Enrollment programs which can be drawn 
on a citywide basis are limited to such areas as the extent to which 
the several projects were implemented as proposed. 

BACKGROUND OF THE PROGRAM 

The Open Enrollment program began in 1960 as one of the New York 
City Board of Education's programmatic efforts to better integrate the 
public schools. Under the original plan minority group parents whose 
children were attending a school composed primarily of minority group 
children could apply for transfer to a school populated by white children. 
If their child was accepted for transfer, he was to be bused from home 
to school and back; transportation was provided by the Board of Education. 

The child's original neighborhood school was designated the 
"sending school" and the school to which he transferred was designated 
the "receiving school." In the initial years, the criterion used for 
designating a sending school was an enrollment of 90 percent or more 
Black or Puerto Rican children combined; this was based on a survey 
conducted by the New York City Board of Education on October 31st of the 
preceding year. 

The criteria for a receiving school were that the school be 
underutilized, have space available for additional children, and 
that it have an enrollment of 90 percent of "other" children (not Black 
or Puerto Rican). This percentage has dropped over the years and is 
now 75 percent "other. 
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In 1966 the Open Enrollment program was included with those pro- 
grams funded under Title I of the Elementary and Secondary Education Act; 
it has been evaluated each year since 1966-67 as were all Title I programs. 

In 1968, although admission to the program continued to be handled 
centrally. Open Enrollment was decentralized so that each district was 
free to develop its own program for utilizing the funds. Under this pro- 
gram a district was allocated $100 per child received in the districts' 
schools under the Open Enrollment program. The basic orientation of the 
program, as noted in the Board of Education's overall program statement, 
was that ". . .the Title I services will follow those children who parti- 
cipate in an organized plan to further integration and leave their poverty 
area schools to do soo 11 ^ 

Now the program includes two groups of children: those whose 
parents have applied for transfer (free choice Open Enrollment children), 
and those children who have been transferred at the instruction of the 
local District Superintendent and whose transfers were reviewed by the 
Zoning Section of the Board of Education. 

For the academic year 1969-70, in addition to these district de- 
signed decentralized programs, there is a centralized program proposing 
the assignment of 200 additional staff positions to receiving elementary 
schools. This program, titled "Augmented Instructional Services for 
Open Enrollment Receiving Schools" will be evaluated separately and so 
is not within the province of this study. 

1 Summary of Proposed Programs 1969-1970, Title I, ESEA, Board of Education 
August, 1969, page 65 « 
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CHAPTER II 

THE PROGRAMS PROPOSED 

The variety of objectives stated in the proposals from the 19 
districts are summarized in Table II-l. This table summarizes the 
"Objectives'* sections of each proposal*, In developing this summary, 
the evaluation team had to resolve the confusion which exists in the 
proposals as to what is included under the standard proposal headings 
of goals, objectives and procedures. The goals and objectives were 
also often disparate and redundant. To further compound confusion, 
there were instances in which a goal or objective was stated or im- 
plied in the procedures section of the proposal without being speci- 
fied in the section devoted to Objectives. We urge the proposal de- 
velopers, both in central and district offices, to eliminate this con- 
fusion in the future. 

The summary of objectives used as the basis of this evaluation 
design was developed from those items listed in the proposal under 
the heading "Ob jectives ." In the sample districts, the district 
Title I or Open Enrollment Coordinator was given the opportunity to 
amend the list prior to our collection of data. None did, so that the 
in-depth study was oriented to evaluating the objectives as originally 
stated in the district proposals. 

OVERALL DISTRICTS 

The objectives have been grouped into three areas: 1) those con- 
cerned with general or specific aspects of academic improvement; 2) those 
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concerned with the provision of guidance and counseling services, and 
the modification and/or improvement in staff and the instructional pro- 
cess; and 3) those concerned with some dimension of the social process 
or the child's personal non-academic functioning. In addition, there 
were some miscellaneous objectives. One proposal listed nine objectives, 
while four districts had as few as two. 

The most consistent concern expressed was with the objectives 
related to social and personal processes; 16 of the 19 districts had at 
least one objective in this area. Two of the districts listed all of 
their objectives in the social and personal areas. This area was de- 
fined by 10 districts in terms of improving interrelationships within 
the triad of school-home-and community. Other consistent emphases were 
on reducing conflict and/or improving adjustment among children ( 8 districts) 
and on fostering integration. Seven districts specifically mentioned 
integration. Since integration is a goal of the Open Enrollment program, 
almost by definition, many districts did not state it specifically. 

There was also consistent concern with academic improvement, most 
frequently stated in terms of reading. Fourteen of the 19 proposals made 
some reference to academic improvement, with ten specifying reading im- 
provement. No other specific academic component was mentioned by more 
than three districts. 

Twelve districts listed at least one objective within the third 
area, instructional and guidance processes; the provision of guidance 
services most often noted. Of the remaining objectives, the use or re- 
cognition of paraprofessiona Is were stated in more than three proposals. 

14 



OPEN ENROLLMENT PROGRAM OBJECTIVES LISTED IN DISTRICT PROPOSALS , 

BY DISTRICT 
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CHAPTER III 
THE EVALUATION PLAN 



overview 

The overall plan for this evaluation had three major foci. 

First, we sought to conduct what might be called a "legal commitment 
evaluation;" that is, an evaluation of the extent to which the program 
elements, as specified in all the district proposals, were in fact imple- 
mented. This was done by developing an instrument called the Principal's 
Implementation Inventory, for the principals of every school designated 
in each district proposal as receiving some service, supply, or staff 
through the district Open Enrollment program. This Inventory was dis- 
tributed to the entire principal population of both districts and 
schools.*" 

The other two foci involved a sample of the districts which had 
active Open Enrollment programs. A sample of six districts was selected 
through the sampling procedure discussed later in this chapter, and 
within these districts 16 elementary, eight junior high schools, and 
four special projects were selected as sites for further study. 

The second evaluation focus was to assess "participant reaction;" 
that is, the reaction of five groups of participants: children, mothers, 
teachers, principals, and district Title I coordinators. Children and 
mothers were asked, through the Student's Questionnaire and Mother's 



X This instrument and return rate are discussed in the Instrument section 
following. 
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Questionnaire to give some overall reaction to the program, looking 
back over their total experience with the program.^" 

Teachers, principals, and district Title I coordinators were 
asked to comment on specifics of the program as it functioned within 
their school or district. A Teacher's Questionnaire, informal interviews 
with the Title I coordinators in the sample districts and the Principal's 
Implementation Inventory were used to gather this information. 

The third focus of this study was on the quality of the pro- 
gram as it was implemented in the sample schools. For this, teams 
of professional and non-professional observers were sent to visit and 
observe classes in the sample schools. The observers sought to see 

the school's normal functioning, with particular emphasis on the Open 

2 

Enrollment program. 

THE SAMPLE OF DISTRICTS AND SCHOOLS 

A two step process was developed to select the sample for this 
evaluation. First districts were selected; then, within these dis- 
tricts, schools were chosen. 

The Sample of Districts 

The proposals from the 19 districts receiving funds for the de- 
centralized Open Enrollment program were divided into two groups based 
on whether or not the budget was in excess of $150,000. Nine districts 

^p or children in an Open Enrollment program for more than two years, and 
for the mothers of these children, the Open Enrollment referent cuts 
across the current decentralized programs and includes the earlier cen- 
tralized program. This was recognized by evaluation project staff but we 
preferred the longer view and we did not feel it feasible to ask the 
children and their mothers to limit their comments to the last year or two 

2 The reader is reminded that not all schools in each district were com- 
mitted to implementing the identical program. Therefore, the observers 
identified their observational^ sites separately for each school. 

18 
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submitted proposals budgeted at less than $150,000, and ten districts 
submitted programs budgeted in excess of $150,000, 

From the 19 districts, a total of six (approximately one-third) 

l 

was decided upon, three from each group, 1 The selection of the six 

i 

sample districts was made by the evaluation staff who attempted to 
choose districts which not only had varied emphases in their program 
statement, but which also had innovative program elements. Thus, we 
selected a district with many elements to its program; a program with 
few elements, and a district which planned a multi-media program, one 
of the newer educational approaches. 

Obviously, this procedure was deliberate rather than random, 
and was used in the belief that given the small size of the strata, and 
the diversity of the program emphases, random selection methods would 
have been satisfying a research principle but might have sacrificed the 
opportunity to place the evaluation efforts in those districts where 
we might learn things of general interest to all districts planning 
future programs. 

All six sample districts invited to participate agreed to do so, 
and the initial interview with the district Title I coordinator was 
completed on schedule. Similarly, the sample of eight junior high 
schools in these six districts agreed to participate. However, the 
implementation of the evaluation in the elementary schools was impeded 
by the reluctance of several elementary school principals in the sample 
districts to participate. They were loathe to permit their schools to 
serve as data collection sites because, they said, the evaluating 
agency was the Center for Urban Education. ^ We were told by ten dif- 



L As will be discussed in the chapter on the Principals Implementation 
Inventory, reluctance to participate for this reason was a citywide 
phenomenon. It is discussed here in terns of the sample districts 



only because this section concerns tKat sample. 
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ferent principals that they, and their professional association, the 
Elementary School Principals Association, had taken issue with several 
educational positions taken or implied in Center publications, (the 
Urban Review was most often mentioned). Moreover, they considered the 
Center to be biased against the administrative staff of the public 
schools. Given this professional disagreement, they did not wish to 
cooperate with, or be a part of, this evaluation. 

Despite strong and consistent support from the Bureau of Educational 
Research of the Board of Education requesting their participation in this 
study, in one district no principal of an elementary school would agree. 

In a second district only one elementary school principal would cooperate. 
The same reluctance was found in an alternate district selected for the 
totally non-cooperating district. The final sample of elementary 
schools thus involves only five of the six districts. 

Selecting schools within the districts with small budgets was 
not a problem, since typically there were no more than one or two parti- 
cipating schools in each district. Within the three larger budget dis- 
tricts where more schools participated, the sample schools were chosen 
to represent the number of children admitted under the Open Enrollment 
program. All elementary and junior high schools in the large budget dis- 
tricts were ranked on the basis of the number of children indicated as 
Open Enrollment children in 16 district proposals. The two sample schools 
were selected to represent a relatively small and relatively large number 
of Open Enrollment children. In one district there were so many elementary 
schools in the district program that a third school representing the 
district median number of admissions was selected. 
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In two of the sample districts, a special program, an Evening 
Guidance Center, was studied. 

In summary, nine elementary and eight junior high schools 
participated, involving five districts at the elementary, and six at 
the junior high school level. 

The Programs In The Sample Districts 

The program objectives specified in the proposals of the six 
sample districts represented good coverage of the list of objectives 
in Table II-l, All four categories of objectives, including the 
"other" category, were represented; the objectives stated in the pro- 
posals of the six sample districts included at least one reference to 
18 of the 24 (75 percent) specific objectives listed. The sample 
districts' proposals did not include the following objectives: 
improvement and/or remediation in arithmetic or mathematics; the provi- 



sion of small group instruction; science learning; speech and speaking 
ability; English as a second language; and the provision of multi- 
ethnic materials, 

THE OBSERVATIONAL VISITS 

This evaluation included both professionals and non-professionals 
on the observational teams. 

The Professional Members of the Teams 



The special competencies sought in the professional members of 
the observation team were determined by the districts' proposals. Each 
district's major emphasis, as stated in the proposal, was the basis for 
selecting the professional observers. One professional was designated 




team leader 
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Eleven different professional observers were used. There were 
five experts in the instructional areas at the elementary and secondary 
level; four experts in guidance, counseling and psychological services; 
one expert in social and community services, and a professional in 
multi-media instruction. Eight of these people were on the faculties 
of three different colleges, and a ninth was on the staff of a residen- 
tial treatment center. Eight of them had had previous experience with 
evaluations of Title I programs. 



The Non-Professional Members of the Team 
a. Recruitment 

It was necessary to recruit parent observers for the 1969-70 
Enrollment evaluation. An attempt was made to find out whether other 
evaluators had used non-professional personnel to evaluate professional 
functioning. Letters to the Office of Economic Opportunity, the Bureau 
of Indian Affairs, and to a past president of the United Parents Assoc- 
iation yielded no relevant information. It was then decided that the 
sample schools' Parents Associations would be asked for their help. A 
letter was sent to 12 sending and receiving school Parents Associations 
informing them of the nature of our evaluation, the conditions of work, 
and the one restriction that a candidate could not be an employee of 
the Board of Education, and asking them to recommend an observer. Only 
four responses were received. Therefore, an alternate plan was 
adopted, in which the United Parents Association was asked to refer 
potential parent observers. This procedure succeeded in recruiting 
an additional seven parent observers, of whom five actually served. 
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b. Descriptive Information 

The non-professionals were all parents, and most had children 
in schools in a sending or receiving school in the decentralized 
Open Enrollment program* Except in one instance when an error occurred, 
no parent was sent to observe in a school attended by her child. 

All of the parent observers were women, and of the nine who 
served, seven were white and two black* All were at least high school 
graduates, with two holding Bachelors degrees and one a Master f s* 

Many had previous work experience, and all (by unanimous agreement of 
the evaluation staff with whom they met) were interested in, and com- 
mitted to, public education* 
c. Briefing and Supervision 

Before any of the parent observers made school visits, they were 
invited to small group briefing sessions. During these sessions two 
members of the evaluation staff went over all the instruments to be 
used, explained the procedures to be followed, and answered any questions 
the parents had. Once school visits were underway, the evaluation staff 
was always available for answering additional questions. 

The Structure and Scope of the Visits 

For. the observational school visits, four-member teams were 
formed consisting of two professionals and two non-professionals. 

Both parents and professional observers were asked to arrange their 
class visits so that the parent observer was always accompanied by a 
professional observer. Individual specialists, for single visits, 
were scheduled as required by the nature of the district program. 
Beginning in March and continuing through early June the teams visited 
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the sample schools at about one to two week intervals.* - To establish 
continuity, one team was assigned to each of the sample districts and 
that team made all of the visits in the district. 2 

The design for this evaluation called for an average of four ob- 
servational visits in the small budget districts, and six visits in the 
larger budget districts. The observational team judged whether fewer or 
more visits were necessary. In practice the anticipated schedule proved 
reasonable. In both of the smaller budget districts participating, four 
observational visits were completed. In two of the three larger budget 
districts, six visits were made; in the third larger budget district 
only three visits were completed, since the team considered additional 
visits would serve no useful purpose. 

A total of 85.5 observer days were spent in the sample schools on 
these 23 visits, AO. 5 days in elementary schools, 34 days In junior high 
schools and 11 days in special facilities or programs. 

INSTRUMENTS AND DATA gathering PROCEDURES 

A total of nine instruments was used in this evaluation: 

1. Interview Guide for Coordinators 

2. Principal's Implementation Inventory 

3. Teacher's Questionnaire 

4. Basic Individual Lesson Observation Report (ILOR) 
for Professional Observers 

5. Basic Individual Lesson Observation Report 
for Parent Observers 

6. Interaction Pattern Analysis for Professional Observers 

7. Building and School— Wide Observations 

8. Mother's Questionnaire 

9. Student Questionnaire 

Copies of all instruments used appear in Appendix B, which provides 
the content but not the layout of the instruments. 

^Absences reduced teams to fewer than the full complement of four members 
in six of the 23 visits. 

2 

In some instances an observer .served on more than one observational team. 
When this happened the observer made all of the visits scheduled for each 
of the teams to which he was assigned. 
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Informal Interview Guide for Title I Coordinators 

In December and January, the Title I coordinators of each of the 
six sample districts were interviewed individually by a member of the 
evaluation staff, in order to acquire an understanding of the nature of 
the programs in these districts, and to obtain the coordinators' per- 
ceptions of how the district program was being implemented. 

Three coordinators relied exclusively upon their own knowledge 
of the programs in their districts; the other three called upon princi- 
pals, reading supervisors, guidance counselors, or other consultants, 
to supplement their own knowledge. In two Instances these consultants 
were invited to be present throughout the interview, and in the third 
they were available for further discussion after the interview with 
the coordinator. 

These interviews were necessarily unique to each district since 
the interview focused on the implementation of the district proposal. 
However, all six coordinators were asked three common questions. First 
they were asked if the objectives stated in the program proposal had 
been amended in any way. Second, they were asked if the program was 
underway. Finally, they were asked about the receipt of the personnel, 
materials and supplies specified in the program proposal. 

Principal's Implementation Inventory 

This Instrument was a highly structured questionnaire, intended 
to serve four purposes: 1) to identify the role each principal played 
in the development of the district Open Enrollment proposal, and his 
perception of the most effective timetable for proposal development; 
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2) to provide a description of the population of the school for both 
the 1968-69 and the 1969-70 school year in terms of grade register, 
class size, and specifically of voluntary and mandated Open Enrollment 
children; 3) to identify the kinds of personnel, equipment and supplies 
provided to the school under the program, as well as any other or 
additional personnel, equipment or supplies the principal felt he 
lacked; and 4) to describe the extent of parental and community involve- 
ment with the school* 

This inventory was mailed to the principals of 240 elementary 
and junior high schools listed as Open Enrollment receiving schools in 
the 19 district proposals. The mailing elicited a flood of complaints 
and refusals to respond. Principals of schools receiving few, or no, 
services funded through the Open Enrollment program saw no reason to 
fill out an extensive questionnaire to report that they received little 
or no service. We agreed, and suggested to them that a simple note to 
this effect would suffice. The refusals centered around the "boycott" 
against the evaluation agency referred to earlier. After several days 
of discussion, some principals agreed to complete the Inventory. 

In early April, a second mailing went out with a cover letter 
from Dr. Samuel D. McClelland, Director of the Office of Educational 
Research, enlisting the cooperation of the schools. In order to en- 
courage as high a rate of return as possible, the Evaluation Chairman 
also sent a letter giving schools the options of either filling out the 
Inventory as completely as possible, or indicating that they had only 
fractional services; or sending a letter saying that they were not an 
Open Enrollment receiving school. 
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By May 26th, a total of 117 responses of some kind ( a 49 percent 
return) had been received from 18 of the 19 districts. There was no 
response at all from 124 schools. Of these 117, 81 were completed or 
partially completed Inventories, 16 were letters or Inventories indi- 
cating only fractional services, and 20 were letters indicating that 
the principal did not consider his school an Open Enrollment receiving 
school. Of the 81 schools that submitted completed questionnaires, 21 
were junior high schools and 60 were elementary schools. Of 16 schools 
sending reports of fractional services, two were junior high schools 
and 14 were elementary schools. 

Since the returns include schools in 18 of the 19 districts, 
the data do serve to accomplish the research purposes of the Inventory, 
although on a sampling rather than the total population basis antici- 
pated. 

Teacher's Questionnaire 

The Teacher's Questionnaire was a simple one-page instrument 
consisting of five free-response questions, and an opportunity for 
additional comments. The five questions were Intended to identify 
those aspects of the district program of which teachers were aware in 
their school, and their evaluation of the Open Enrollment program as 
| it functioned in their school. Specifically, they were asked to dis- 

cuss the program's effectiveness, strengths and weaknesses, and to 
suggest improvements. The questionnaire was to be mailed directly 
back to the evaluation office. 

The Teacher's Questionnaire was placed in the letter boxes of 
all 639 teachers in each o£':five elementary schools and five junior 
O high schools which were chosen on the basis of their relatively large 

ERJC £7 



19 



Open Enrollment registers. Despite the brevity of the instrument only 
61 were returned. The return rate of 9.5 percent makes the information 
suggestive at best. 

Basic Individual Lesson Observation Report (ILOR) : 

For Professional Observers 

This instrument was used by the professional members of each ob- 
servation team. It was adapted from the I LOR used in several previous 
evaluations For this evaluation, the questions centered on five areas: 
1) a description of the lesson observed in terms of who taught it, its 
content and methodology; 2) teacher functioning as reflected in the 
planning, use of materials, ability to elicit pupil response and parti- 
cipation, classroom climate and atmosphere, and effectiveness of teaching 
style and method; 3) children*® reactions, responses and participation; 

4) inter-class interactions; and 5) overall appraisal of the lesson, 
and specifically its strengths and weaknesses. For those districts 
which emphasized remedial reading services, additional items were added 
for the reading specialist on the observational team. These items asked 
for descriptions and evaluations of the techniques used in the remedial 
reading groups. 

A total of 135 lessons was observed by the professional members 
of the observation team, 70 at the elementary, and 65 at the junior high 
school level. In addition, 40 remedial reading lessons were observed, 

21 at the elementary level, and 19 at the junior high school level. The 
70 elementary level lessons most often observed were: reading 35 (50 per- 
cent), mathematics 7 (10 percent), social studies 5 (7. percent), English 
and language arts 6 (9 percent). 

^The technical aspects of this instrument are discussed at length in the 
report of the evaluation of the. More Effective Schools Program . The 
O Center for Urban Education, December 19.68. 

:R1C 
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Basic ILOK: For Parent Observers 

The parent observers completed a briefer version of the IIX)R 
intended to elicit a description of the lesson (who taught it, the con- 
tent, the kind of grouping, if any); the children's reactions and res- 
ponses; and their "vote" as to whether or not they would like their 

. . child to be in this class even if he had to be bused to attend? 
Parent members of the team observed 109 lessons. 



Interaction Pattern Analysis : 

Observation Team 

In an effort to obtain some quantitative estimate of the nature 
of the interactions among children in the classroom, professional and 
parent observers were asked to indicate on a chart or matrix, the 
frequency of interactions observed among children, considering sex 
and ethnic status (White, Black, Spanish speaking, and other). 

Interaction patterns were completed for 114 lessons by professional 
observers at the elementary level, and for 45 at the junior high school 
level. The patterns were completed by parent observers for 101 lessons: 

38 at the elementary, and 63 at the junior high school level. 

The original plan was for each observer, professional and parent, 
to fill out three interaction matrices during each observed lesson. 

The first of the interaction matrices was to be filled out during a five 
minute period at the start of a lesson, the second during a five minute 
period in the middle of a lesson, and the third toward the end of the 
lesson. If the observer could not handle all the instruments in the 
course of one lesson, he was free to omit one or more of the interaction 

matrices. 





21 



Building and School- mde Observations: 

Observation Team 

Each member of the observational team mas also asked to complete 
a Building and School-Wide Observation form at the end of the observa- 
tional day. This form was intended to provide the evaluation staff 
with ratings of the physical characteristics and facilities of the 
building Ci.e., lunchroom, library, science laboratories), and the over- 
all atmosphere of the school# 

In all, 33 Building and School-Wide Observation forms were com- 
pleted by professional members of the observation team in 16 elementary 
and 17 junior high schools. Parent observers completed 24, in 14 
elementary and 10 junior high schools. 
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Mn^er's Questionnaire 

During prior evaluations of the centralised Open Enrollment 
program a variety of efforts to elicit responses from parents had not 
succeeded in producing any substantial response. Since the effort had 
no t been made in the previous year of the decentralised program, it was 

decided to try again this year. 

A brief questionnaire was developed and printed on the back of 
a 5" * 8" postcard. The questionnaire asked the child's mother to rate 
her satisfaction with her child's progress, and to describe the extent 
of her participation in Parents Associations and of her visits to school. 
In addition, the Mother's Questionnaire for children being bused under 
the district Open Enrollment program asked whether or not the parent 
had requested the transfer. 

years of the centralized program. 
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The questionnaire was distributed in four elementary schools and 
five junior high schools, while the Pupil Questionnaires (discussed 
below) were being administered, 1 In the elementary schools. Form S of 
the Open Enrollment Mother f s Questionnaire was distributed to those 
children who indicated that they took the school bus to school# All 
other children were given the alternate Form R for receiving school 
mothers. Junior high school pupils received an Open Enrollment Mother 1 s 
Questionnaire if they indicated that they had ridden the school bus in 
elementary school; if they had not, they received receiving school 
Mother^ Questionnaires, In all, 173 Open Enrollment Mother 1 s Question- 
naires and 361 receiving school Mother*s Questionnaires were distributed. 
Of these, 17 questionnaires were received from mothers of children 
being bused and 80 were received from mothers of children in the receiving 
schools. 

Student Questionnaire 

Student opinion was obtained by simply asking children in sample 

junior high schools to describe their experiences while attending a 

2 

school in which some children came from other districts. 

The questionnaire was distributed to a total of 302 children in 
three classes in each of five junior high schools, chosen because of 
relatively high registers of Open Enrollment children# Responses were 

One elementary school principal requested that the forms not be dis- 
tributed and his request was honored, 

^The reader is reminded that the responses to this instrument also cut 
across the two years of decentralized Open Enrollment programs and the 
preceding years of the centralized program# 







23 



received from 103 students in five different junior high schools. Of 
these, 61 were received from resident children and 42 from those who 
had been bused at some point in their school career, and 167 handed in 
blank sheets. 
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CHAPTER IV 

FINDINGS: PERCEPTIONS OF DISTRICT TITLE I 
COORDINATORS, PRINCIPALS, AND TEACHERS 



This chapter presents the findings from the interviews with the 
Title I coordinator of each of the six sample districts, the responses 
of principals to the Principal's Implementation Inventory, and the 
responses of the teachers to the Teacher's Questionnaire. 



PERCEPTIONS OF TITLE I COORDINATORS 



As noted earlier, the six district Title I coordinators were 
interviewed individually to obtain their perceptions of the implementa- 
tion of the district program. Since three coordinators asked others 
(e.g., principals, reading supervisors, guidance counselors) to supplement 
their own knowledge, this section will differentiate the coordinators' 
views from the views of these consultants. 



Personnel. Materials and Equipment 

With one minor exception the coordinators said that they had 
received the personnel requested j one coordinator said he had received 
the personnel he requested, but that he had requested fewer than he 
desired because of limitations on the amount of money available for 
salaries. He felt that he could use more people, and added that the 
formula for paying the district for Open Enrollment children was out of 
date since salaries had increased since the last change in the formula. 

In the opinion of the coordinators, the situation in regard to 

materials and equipment was far less satisfactory. Last year's materials 
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were still being delivered in some districts. One coordinator thought 
he had received everything requested in the 1969-70 proposal 1 and that 
was because he had funds available to commit for early ordering. One 
coordinator was not sure what had been received. The four others in- 
dicated that since formal approval of the program budget had not yet 
been received, ordering was just getting under way. These four dis- 
tricts were using material and equipment left over from the previous 
year or on hand in the school, and were planning to replace it when 
their orders came through. 

Parent and Community Involvement 

All of the proposals made reference to greater parent and community 
involvement and five of the six coordinators agreed that parental in- 
volvement was important, but nobody was really satisfied with the degree 
of involvement achieved. The coordinators pointed out that the schools 
were using a variety of means to ensure parent involvement, including 
teas, workshops, a parent clinic that provided assistance with health, 
welfare, housing and other problems, and evening facilities to encourage 
parents to come to the school and participate in its activities. Guidance 
counselors held workshops with some parents and in two districts both 
children and their parents were involved in the corrective reading pro- 
gram. However, even the effort to employ paraprofessionals from the 

1 The reader is reminded that these interviews were conducted in December 
and January. 
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sending communities, and in this way bring out-of-district parents 
into the schools, was not always successful in attracting parents from 
sending areas. Despite everything, the coordinators felt that parent 
participation, and in particular participation by sending school 
parents, was still inadequate. 

Problems With Fuhding 

All of the coordinators brought up some aspect of the funding 
problem. One pointed cut that the district proposal was tailored to 
a budget rather than to its needs. Another, as noted above, made 
references to the obsolescence of the formula for paying the district 
for receiving Open Enrollment children. All of the coordinators felt 
that their inability to order materials and supplies early enough 
posed a very serious problem; because they had not yet received final 
program approval they could not send in their orders. 

Everybody felt that the sequence and timing of the whole program 
was much too late and resulted in problems in planning and staffing 
as well as in ordering materials. One district Title I coordinator 
said that although they had managed to employ a fine guidance 
counselor, the timing problem had caused them to lose the opportunity 
to employ the person who was their first choice. 

Recommendations of Coordinators 

The six coordinators made a number of recommendations as a 
result of their experiences with the program. One principal called in 
by the coordinator suggested that the Center For Urban Education make 
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its evaluation without any preconceived ideas. He went on to suggest 
that evaluation should be part of project planning and that represen- 
tatives of the evaluation team should sit down with district staff 
to work out the proposals. Another coordinator suggested that funding 
be for a longer period of time in order to achieve continuity and to 
make it possible for the district to plan for a two or three year 
period. 

The coordinator who was concerned with the funding formula 
recommended that funding be based on $150 per Open Enrollment pupil 
rather than on the present formula of $100. Still another coordinator 
recommended, as a solution to the materials problem, that each district 
should receive an advance of five to seven percent of its project 
money several months before the school year, so supplies can be ordered 
far enough in advance to be available at the beginning of the year. 

All coordinators agreed on the necessity for earlier funding in order 
to have adequate time for planning and recruitment as well as ordering. 
Dates from January on were mentioned as appropriate starting dates 
for work on the proposal with final approval no later than June. 

PERCEPTIONS OF PRINCIPALS 

The perceptions of principals reported here come from the 
Principal’s Implementation Inventory. In addition to the questions 
about personnel and services that their school received under the 
district Open Enrollment program, the Principal’s Implementation 
Inventory included questions intended to obtain the principal’s 
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perceptions of his role in the development of the district proposal, 
and the ideal time schedule for the different stages of proposal 
development. 

In total, 97 Principal's Implementation Inventories were re- 
turned, 81 completed and 16 partially completed. These 97 respondents 
represent 18 of the 19 districts with Open Enrollment programs, and in- 
volve 71 elementary and 26 junior high schools. Since the number of 
respondents for each specific question varied more widely than is usual 
on a questionnaire, the number responding to each question was used as 
the base for the computation of percentages, and that referent number 
will be indicated in the discussion of each question. 

The Preparation of the District Proposal 

Seventy of the total 97 respondents answered the question asking 
for a description of their role in developing the district proposal for 
the Open Enrollment program. Three noted that they had become principal 
at the beginning of the year, and so could have had no role; 41 wrote 
in the word "none" in response to this question. Undoubtedly these 
figures are a minimum estimate of the extent of non-participation by 
the principals, for if one assumes that all the 27 principals who left 
this question blank also had no role to report, non-participation rises 
to 70 percent (68 of 97). The 26 who indicated some role represent ten 
different districts. There was one district in which participation had 
been outstanding; of 12 respondents, 11 indicated participation in pro- 
posal development. Other than this one district, there was only one 
other in which more principals indicated participation than the number 
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indicating non-participation 
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These 26 principals had primarily been resource people for the 
proposal in their districts. Eight principals used the identical 
phrase: "ideas for recycling the program were discussed at a District 
conference." Six principals reported suggesting specific services to 
be provided or problems with which the proposal should deal, and two 
principals provided statistical data needed for the proposal. Six 
other principals reported a role more concerned with Implementation 
than development, by noting they conducted orientation sessions for 
teachers and/or parents. 

Although not many principals had participated in developing 
the' proposal, most (81 percent) felt that they were familiar with it, 
either "to some extent" (37 percent) or "completely" (44 percent). 

One principal in five (19 percent of the 75) who responded to this 
question reported that he was "not familiar" with the district pro - 
posal. It Is a serious matter when, by mid “year, one In five prin~ 
cipals responsible for implementing some part of a program reports no 
familiarity with the proposal for that program. 

Table IV-1 below summarizes the principals* views about the 
ideal time cycle for developing Open Enrollment program proposals. 

The respondents were asked to Indicate the "ideal beginning time for 
the seven aspects of program development listed, and for the latest 
final date of funding. 

A glance down the two columns at the right side of the table 
makes clear that few principals felt that beginning work on any of 
these aspects could properly be delayed beyond the end of the year pre^. 
ceding implementation. The one major exception are those who felt that 
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Five percent suggested funding could be finalized in the period January to April of the year of 
implementation. 
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the "orientation sessions with paraprof essionals" could be begun either 
during the summer (8 percent), or at the beginning of the year of im- 
plementation (13 percent). 

Two activities were felt by the principals to require the 
earliest beginning. Forty percent felt that planning and programming 
should begin no later than February of the year before implementation, 
and half (49 percent) believed that supplies and equipment must be 
ordered by that time. The other activities, including recruiting and 
orienting staf^ and final funding^ could be delayed until after February, 
but between one-third and one-half of the principals believed that even 
these activities should be begun no later than April of the year pre- 
ceding implementation. 

Staff Supplied by Program 
a. Numbers Proposed and Provided 

Data on the staff supplied to schools through the district Open 
Enrollment program were obtained from a summary listing of staff supplied 
by the Office of State and Federally Assisted Programs (OSFAP) of the 
Board of Education. In the Principal's Implementation Inventory principals 
were asked to indicate the total number of teachers and paraprof essionals 
provided for, and in the same instrument they were asked to indicate the 
number provided by position, e.g., corrective reading teacher, art 
teacher, and so on. 

The data provided by elementary school principals when asked to 
indicate the total numbers of teachers and paraprofessionals " . . .paid 

from Open Enrollment funds," had little relationship to the data provided 

O 
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when they were asked to Indicate, position by position, the number of 
M . , . special personnel ^whlch/ have been assigned to your school to 
Implement the Open Enrollment program* 11 * The elementary level principals 
reported 75 percent more teachers by position than they reported by 
total; for paraprof essionals the number reported by position was almost 
twice as great as the total number reported. The junior high school 
principals* reports were equally unreliable for teachers, but were 
accurate for paraprof essionals* 

Two findings are clear from these data: First, that the elementary 

school principals responding were not completely certain In their own 
minds as to who on their staff was paid by Open Enrollment program funds; 
and second, that at the elementary level principals generally said that 
they received more teachers and paraprofesslonals than the OSFAP list 
indicated* At the junior high school level, principals generally In- 
dicated that they had received fewer teachers and paraprofesslonals than 
o 

Indicated. In either case, the data Indicate a clear need for Improved 



In retrospect, the evaluation staff realizes that the subtle difference 
In wording between the two questions was an error* It opened up the 
possibility that a school receiving additional staff paid by regular 
district lines because It was asked to Implement the Open Enrollment 
program, could properly have included these staff In the second question* 
The numbers of staff Involved In this kind of misinterpretation, however, 
could not account for any significant part of these discrepancies* More 
likely, the structured listing by position either made the principal 
aware, or suggested to him, that teachers In certain positions were paid 
for by Open Enrollment funds* 

o 

Both these generalizations are based on the way three of the four 
possible comparisons come out at each level, i*e*, comparing the OSFAP 
list to the principals* total, and to the by-position data for teachers 
and paraprofesslonals. 
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communication between the OSFAP and the schools receiving services. 

In 16 of the. 19 proposals, the number of staff by position was 
included in the districts* proposals. 

There is a reasonably close correspondence among the data for 
teachers at the junior high school level from all three sources of 
information (41.2 received, 42.2 proposed by districts, 45.4 by the 
OSFAP list). However, at the elementary level these principals re- 
ported having more teachers paid by Open Enrollment funds (80.9) than 
the proposals Indicated would be provided (54.9), or the OSFAP list 
noted (60.6). For paraprofessionals , the finding was reversed: at the 
elementary level principals reported about the same number (101.8) as 
the district proposals indicated would be provided (110.0); whereas, 
at the junior high school level, fewer paraprofessionals on staff were 
indicated by principals (31.8) than was indicated in the proposals (68.0), 
or on the OSFAP list (61.0). 

Examination of the data indicates that the excess of teachers re- 
ported by elementary school principals was even more discrepant than 
the totals suggest, for the district and OSFAP list includes 10.3 and 
9 # 0 teachers respectively provided to schools in which the principal 
responded that he was not an Open Enrollment receiving school and/or was 
receiving no services at all. This same phenomenon is apparent at the 
junior high school level for paraprofessionals, five of whom were re- 
ported as going to schools which disclaimed receipt of any services. 

The conclusion from these data is that there is confusion between 
the central staff at the Board of Education, the district staff responsible 
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for the proposal and district program, and the principals of the 
schools ultimately receiving services as to what personnel the Open 

Enrollment program is supporting. 

Perhaps more important is the fact that while the data indicate 
that the funds for staff are being used to support the indicated ser- 
vices, these staff do not seem to fit the model of new additional staff 
specifically recruited to fill roles within a program. Rather, as 
noted in the 1968-69 evaluation of the program, these staff continue 
to fit the model of services already on a school's table of organization 
before the program. The only new element is that the services are now 
charged to the account of the budget for this program. 

The evaluation staff raises the question of whether this is 
fulfilling the spirit and intent of this decentralized Title X program, 
to have "service follow the child." It would seem that almost by 
definition, the addition to a school of children needing remedial and 
supplementary services would require additional personnel, 1 as several 
principals also noted. 

b. Satisfaction with Paraprofessional Staff 

One specific dimension of staffing was studied. Table IV-2 
presents the proportions of principals who indicated their satisfaction 
with the amount of paraprofessional help available for each of six 
kinds of duties listed on the questionnaire. 



1 The evaluation team sees the wisdom of using experienced staff already 
in a school to implement these programs where possible. The point 
raised here is not that specific teachers were already in ^ ^hoois 
but that the specific positions were directed to providing the same 

services. 
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TABLE IV -2 

PERCENTAGE OF PRINCIPALS INDICATING SATISFACTION 
WITH EXTENT OF PARAPROFESSIONAL HELP AVAILABLE 
BY DUTY OF PARAPROFESSIONAL 



DUTY 



N 



I have 
enough 



Percent of Principals Selecting Option 

I HAVE NONE, 
and I do not 

I HAVE SOME, I HAVE NONE, see the need 

but not but I would for any for 

enough like some the current 

program 



a. Supervise OE 

children on 
buses 68 

b. Supervise OE 
children 

during lunch 72 

c . Tutor OE 

children on 
a one-to-one 
basis 71 

d. Help in 
instruction 
of groups of 

OE children 69 



9 1o 



6 



7 



6 



e. Help prepare 
materials for 
teachers 68 15 



f. Make home 

visits and/or 
work with 
parents of 
OE children 



70 



49 i 

58 



27 



31 



38 



32 % 
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65 



57 
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23 



70 



3 



